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ABSTRACT 


The purpose of this report is to establish a procedure for 
evaluating the accuracy of position determinations accomplished by 
satellite photogrammetry. While this test plan is directed specificall- 
toward the multiple orbit adjustment of the existing DAFF photography 
it is sufficiently general to be applied to any photogrammetric adjustment 
employing orbital constraints. 

The method employed consists of removing systematic errors so 
that accuracy and precision become nearly equivalent and then performing 
a complete error propogation in the photogrammetric intersection of 
points whose positions are known. The checking for systematic errors 
is accomplished by separating the residuals from the orbit adjustment 
into subsets based on similarity of observing conditions and comparing 
the mean and standard deviations of each subset with the same statistics 
associated with the whole set of residuals. Statistical tests are then 
employed to determine whether or not the deviation of this subset from 
the whole could be expected to result from chance. If it cannot, the 
physical characteristics of the subset provides a clue to the type of 
systematic error encountered. Methods for the removal of many of these 
systematic errors are given. 

In intersecting the ground points whose geodetic positions are 
known, observational errors due to the photo coordinates, orientation 
angles, and orbital positions are carried through the statistical 
analysis. Furthermore, the covariance among the several exposure station 


positions is employed so that a true estimate of the expected error is 
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obtained. Statistical statements can then be made about the distance 
of the true points from *heir computed counterparts, and since true 

position is known the validity of the statistical analysis is reaiii-+ 
checked. Since these check points are well distributed cover the land 
surface ‘of the earth. the accuracy of computed terrain point positions 


can be obtained as a function of latitude and longitude. 
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1. INTRODUCTION 


The purpose of this report is to set forth a procedure to be 
used to appraise the accuracy of a simultaneous adjustment of data 


from several satellite missions. Although this test plan is aimed 


at evaluating two specific programs, the ID cco Program 
and tne EP c2-0 Program. and the results of adjustments 


by these programs of existing DAFF photography; sufficient generality 
is maintained so that the same test procedure can be applied in the 
evaluation of similar results from future adjustments. The technique 
employed consists of (1) The removal of systematic errors, (2) Use 
of the adjusted orbital camera stations to compute the positions of 
known geodetic control points and the accompanying propogation of 
random errors in the computed positions. and finally (3) Evaluation 
of the predicted magnitude of the errors in comparison with the known 
difference between true and computed positions. At the present time 
the areas in which geodetic control points are available may not 
provide a geometric distribution that will permit a conclusive test 
to be performed, but as more and better control becomes available in 
strategic areas greater confidence can be placed in the results of 
such a test. 

Tests which have been conducted, or are in progress at the Army 
Map Service to evaluate the accuracy of each individual mission ad-~ 
justment have been consulted in the preparation of this report. The 


procedures employed in these tests and the standardized technique that 
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has evolved in the course of solving some of the operational problems 
encountered have been very helpful. Furthermore, mich of the data 

to be used in the test herein described has already been gathered for 
use in evaluating the adjustment of individual missions. 

The need for a plan for testing the accuracy of results 
obtained from the simultaneous adjustment of all DAFF missions was 
first recognized i -: G.I.M.R.A.D.A. It was 
through his efforts and those of several individuals at 0.C.E. and 
the Army Map Service that such a study was initiated and a contract 
subsequently awarded to the Itek Corporation to design this plan of 


test. This effort has been made possible through the cooperation 






of many people at the Army Map Service; principally Messers 


of Itek personnel who have contributed to the development include 


provided assistance in areas of photogrammetry 


Messers 





and celestial mechanics that could be considered unclassified. The 


final compilation of material and writing of the text was done by 
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2. ACCURACY AND PRECISION 


When statistical statements are made about the quality of the 
results obtained from an adjustment employing real data, it is 
usually precision that is being discussed. Precision is the estimate 
of the errors remaining in the final results due to random errors in 
the original observations. By adding to the precision estimate the 
systematic error, which is probably unknown, an estimate of the 
accuracy of the final results can be made. Hence, if all systematic 
errors can be removed or reduced below a significant level. the standard 
error propogation formulas employed by staticians will yield estimates 
of accuracy -- accuracy and precision being equivalent under these 


circumstances. 


2.1. Detection of Systematic Errors 
The purpose of the Least Squares adjustment process is to 


minimize the sum of the squares of redisuals in the observed variables. 
Although the use of a least squares technique does not require that 
any severe restrictions be placed on the distribution of these resid- 
uals, it will be found convenient to assume that they are normally 
distributed. If such an assumption is found to be justified, the 
results obtained from a weighted least squares adjustment will be 

the same as would result from a maximum likelihood adjustment, and 


the more convenient set of statistical tests based on the assumption 
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of a normal distribution of errors can be applied. However, an 

even more basic assumption on which all statistical tests are based 
is that the errors in the observed data are random, i.e., that all 
systematic errors have been removed. It will be necessary to perform 
‘extensive tests to ascertain whether or not all systematic errors 
have been reduced below a negligible level, and to evaluate the 
magnitude of any residual systematic error so that it can be compen- 
sated for. 

Since the residuals obtained from the RECAP Program are weighted, 
that is each residual has been divided by the standard deviation associated 
with its observation type, the observation residuals form a population 
that is believed to be normally distributed with a mean of zero and 
a unit standard deviation. By the very nature of a Least Squares 
adjustment it is assured that the mean of the total set of residuals 
will be zero. If the quality control procedures, employed to ascertain 
whether or not the combined set of orbital models provided a best fit 
to thie: Sbeervation data, included a x* test on the variance of the 
observation residuals, the assumption of a unit standard deviation is 
known to be justified. The remaining assumption to be checked is that 
the residuals are normally distrituted. A test of the validity of this 
assumption can be performed by fitting the residuals to a normal dis- 
tribution function by a Least Squares adjustment. The goodness of fit 
of the residuals to this normal distribution function with zero mean 
and unit standard deviation can then be checked by the application of 
a x” test. 
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However, there is little value in going to such great lengths to 
determine whether or not the residuals are normally distributed. 

It is more advantageous to restrict the statistical tests to be 
applied to those that are least affected by the non-normality of the 
distribution. Reference 9 states on page 173 that the Student's t 
and variance ratio (or F-ratio) tests can be used with some confidence 
even if the distributions concerned are quite non-normal. Therefore 
these two tests are used exclusively throughout this test plan, and 
the assumption of normally distributed residuals accepted without 
question. 

Since the set of all residuals from the simultaneous multiple 
orbit reduction are normally distributed (or near normally distributed) 
with zero mean and unit standard deviation, then all subsets of these 
residuals chosen at random should have the same distribution. A random 
choice of subsets infers that the magnitude of the residuals is not 
to be used as a basis for selection, but since the residuals are assumed 
to be independent, subsets based on common physical characteristics of 
the original observations should have the same mean and standard deviation 
as the total set. If a subset of the residuals, chosen on the basis of 
some common feature in the original observations, is found to have a 
mean or standard deviation that is significantly different from the 
mean or standard deviation of the total residual set, a systematic 
error correlated with, if not caused by, the common characteristic of 


this subset should be suspected. 
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It is impossible to separate the residuals into all of the 
physically distinguishable subsets. A great deal of judgement mst 
be employed in order to discover the possible sources of systematic 
errors without initiating a residual sorting project that is too 
ambitious. A very important consideration is the iikelihood of 
finding a systematic error versus the manhours required to segregate 
the residuals that belong to that subset. The most practical approach 
appears to be the separation of residuals based on characteristics that 
are used in the identification of the residual, and are therefore readily 
available. Further separation into subsets that are not so easily 
distinguishable would be avoided unless there is some reason to believe 


that some systematic error has gone undetected. 


2.2. Propogation of Random Errors 


If all systematic errors have been reduced to an insignificant 
level, accuracy and precision are equivalent. The accuracy of a computed 
parameter will then be given by its variance, or more precisely the. 
covariance matrix associated with all parameters computed in the adjustment. 
The covariance matrix of the computed parameters is a function of not only 
the random errors of observation but of the geometric distribution of the 
observations as well. Therefore it is essential that the expected accuracy 
of ground point locations be computed so that accuracy checks will be made 
against this figure. If it is found that the actual positions of ground 
points are within the error bounds established by the computed covariance 
matrix, then an extimate of the accuracy of any ground point can be obtained 


by direct computation. Knowing the accuracy of a computed ground point 
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location is a desirable capability even if this accuracy does not 
meet expectations. 

In the adjustment process certain parameters which express 
the position of the vehicle as a function of time will be computed 
from the various observation data. Because there are random errors 
in the observations (it is assumed that sit So steaattec errors were 
removed from the observations before they were used in the adjustment), 
there will be errors in the computed positions which can be predicted 
by standard error propogation techniques. When the expected value 
_of the random errors in two exposure stations are found by a rigorous 
error propogation, the covariance between the positions of these stations 
is also obtained. This set of covariances is important because it reflects 
the relative error between two stations, while the two station covariance 
matrices show the absolute error in the pair. For example, if a point 
on the ground is to be intersected from two stations that have little 
or no correlation, the variance in the intersected point will contain 
the sum of the variances in the two exposure stations. If. however. 
the two stations were highly correlated, the variance in the inter- 
sected point would not be much larger than the individual variance of 
either exposure station. Very unrealistic results can be obtained if 
large correlations between exposure stations are ignored. 

In the orbit adjustment the orlentation angles of each exposure 
were considered to be known perfectly from the stellar exposure and 
were therefore treated as error free. In most cases this assumption 


was justified because the orientation angles were determined from 
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stellar exposures to a precision far greater than any of the other 
observed quantities. However, when these exposures are used to 
intersect points on the ground, the errors in orientation contribute 

to the errors in the intersected point and should not be neglected. 
Since the ortentation matrix of each frame is obtained from a Least 
Squares adjustment of the stellar data, the covariance matrix associated 
with the orientation is readily available and should be employed in 
any error propogation to computed points on the ground. The resulting 
propogation of random error in the absence of systematic errors will 
yield precision estimates associated with the computed ground point 
position which can be tested by direct checking of the known position. 
Thus the removal of systematic errors can be checked and if. found ee be 


complete, the precision values can be interpreted as accuracy. 
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3. TeST PROCEDURE 


The following paragraphs outline a test procedure to be 
used in assessing the accuracy obtained from a simultaneous 
adjustment of data from more than one photographic satellite mission. 
The procedure with minor modifications can be applied to the results 
from either the TRACE-D or the RECAP Program. This test is aimed at 
determining the accuracy of a point on the ground that was positioned 
by photogrammetric intersection from two or more exposure stations 
whose positions have been obtained from the orbit adjustment. The 
accuracy of this ground point is necessarily poorer than any of the 
orbital positions used in its computation, because additional errors 
will be introduced by the intersection process. 

This test can be used to compare the accuracies obtained from 
TRACE with those of RECAP only under certain circumstances. For 
instance the same gravitational model must be used in doth programs 
if the results are to be compared and interpreted to be differences 
in the two programs. Furthermore, the rejection criterion used to 
eliminate bad observations must be made an comparable as possible 
for the two programs. Since RECAP rejects observations which give 
rise to residuals larger than some multiple of the atandard deviation 
of all residuals, and since this is the more statistically acceptable 
criterion, a final iteration of TRACE must be made on which the 


rejection level is made to coincide with the particular mltiple of 
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the standard deviation of all residuals. Even so there will be 
differences in the results of the two programs because of the way in 
which the air drag model is applied, the inclusion or exclusion 
of the lesser perturbing forces such as third-body effects or 
radiation pressure, and the means by which the adjustment is performed. 
While the procedure given in the following paragraphs is 
sufficiently general to test the accuracy of any multiple orbit 
reduction, some of the details would necessarily change if at some 
future time more areas of geodetic control points become accessible 
or more missions are available. Furthermore, future data might carry 
with it more identifying information which would allow more sources 
of systematic error to be isolated. For example control points might 
also be identified by local datum, map series. etc.. and ground 
tracking data (as used in RECAP) might carry along the elevation 


angle to aid in analyzing the effects of residual refraction. 


3.1. Detection and Removal of Systematic Errors. 

As described in Section 2 systematic errors will be detected 
by dividing the observation residuals into subsets based on some 
physical characteristic and comparing the mean and standard deviation 
of each subset to the equivalent statistics for the full set of 
residuals. It is assumed that the observation residuals are available 
on a magnetic tape or some other storage device in the order in which 


they were computed and that each residual is accompanied by certain 
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auxiliary data such as would be required in order to obtain the 
partial derviatives of each observation equation with respect to 
the vehicle position. If these data are not a part of the 

residual record, only a minor program modification will be required 
to obtain them since they are available in the computer at the 

time that the observation residuals are formed and output. If only 
the positions of station and Gaiteis- ges included in the residual 
record, subroutines used in the formation of the system Normal 


Equations may ove used to recompute the required derviatives. 


3.1.1. Procedure for Range Residual Analysis 
1. Obtain the set of residuals from all observations of Mission 
No. 1 from Radar Station No. 1. Compute the mean of this sample, given 


by n 


v= : aa (1) 


and compute the statistic 


v¥n 
t= 0 (2) 


where o is the standard deviation associated with the total adjustment. 
If the absolute value of t is greater than the value given in Table 1 
for the appropriate sample size, the hypothesis that the mean of this 
subset of residuals is equal to zero mst be rejected at the 10% level 
of significance. More simply stated this means that the probability 


that a systematic error is affecting this subset of observations is 
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The failure of this "Student's t-Test" is to be recorded 

~— iii sple 3a or 3b depending on whether the residuals from the 
‘ or TRACE adjustment are being analyzed. 

2. Compute the variance of the residual sample acquired for 

TITS To azpeve test using the forma 
s* = +> (3) 
i=1 

atti aii=-==ne hypothesis of a zero mean was not rejected in the previous 


If this hypothesis was rejected, the more involved com- 


ee ee ee) ON) 
n 
Zz = 
s = (vz - v)* 
> ait (Ls) 
4=1 


pe used. Next compute the statistic 
52 
Soa (5) 


does not fall between the values of Fogg and Fo os given in 

_.. 2, the hypothesis that this subset of residuals has the same 
——=======—==nce as the total residual set must be rejected at the 10% 

This failure of the sample variance to satisfy an F-ratio 
 ito++~~-~--~-~should be recorded in Table ha if the residuals are from a 


.tacssissustsy adjustment or Table lb if a TRACE-D reduction produced them. 
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3. Repeat (1) and (2) using the residuals from observations 
from Radar Station No. 1 of Mission Nos. 2, 3, 4. 5. and 6. 
4. Repeat (1) through (3) using the residuals from all 


observations made from Radar Stations Nos. 2, 3, lh. and S. 


3.1.2. Procedure for Tracking Camera Residual Analysis 

1. Obtain the residuals from all observations of Mission No. 
1 from Tracking Camera No. 1. Compute the mean of the right ascention 
residuals and the mean of the declination residuals separately. each 
from a formula equivalent to (1), and then compute the "t" statistics 
associated with each of these means from formula (2). Compare the 
absolute value of t, and ts with the appropriate entries in Table 1 
and record in Table 5a or 5b, which ever is applicable, the failure 
or either value of t to satisfy the t-test criterion. 

2. Next compute the variances in the right ascension and 
declination residuals using formula (3) or (lL) depending on whether 
or not the t-test was satisfied in the previous step. For each of 
these variances compute the F-ratio given by formula (5) and use chews. 
quantities in performing an F-ratio test analogous to that described 
in (2). Record the failure of either to satisfy the criterion of 
Table 2 by checking the appropriate box in either Table 6a or 6b. 

3. Repeat (1) and (2) using residuals from observations made 
by Tracking Camera No. 1 of Mission Nos. 2, 3, h, 5, and 6. 

4h. Repeat (1) through (3) using the residuals from all obser- 


vations made from Tracking Camera Nos. 2, 3, ..... etc. 
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3.1.3. Procedure for Control Point Residual Analysis 

Each photogrammetric control point will have associated with 
it five different residuals -- the residuals from the two photo 
coordinates and the residuals of the three coordinates of the control 
point since these control point coordinates were considered to be 
observed variables. In view of the fact that these residuals fall 
into two distinct types, they will be considered separately. 

1. Obtain the set of residuals from all photo coordinates 
from photograph No. 1 of Mission No. 1. Form the mean of these 
residuals without separating by x and y-coordinates, and then compute 
t. Equations (1) and (2) can be used. If the absolute value of t is 
greater than the value given in Table 1, record the number of this 
frame for future reference in a list of frames that have failed to 
satisfy the Student's t-test. 

2. Compute the variance of this residual sample using equation 
(3) or (4), whichever is appropriate on the basis of the above t-Test. 
Next form the F-ratio; equation (5), and check to see that it falls 
within the acceptable limits specified by Tabie 2. If it does not. 
record the Frame No. in a list of frames that have failed the F-ratio 
test. 

3. Repeat (1) and (2) for each photograph from Mission No. 1. 
Enter the total number of frames which failed to satisfy either test 
in Table 9a or 9b. 


4. Repeat (1) through (3) for each mission. 
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5. Obtain the set of all control point coordinate residuals 
observed by mission No. 1 which were transformed to the World Geodetic 
System from major datum No. 1. Form the mean of the X-coordinate 
residuals, the mean of the Y-coordinate residuals, and the mean of 
the Z-coordinate residuals. Then compute the associated t statistics 
and compare each of the three to the values given in Table 1. List 
the Control Points that fail to satisfy the t Test and identify them 
by latitude and longitude if this information is available. 

6. Form the variances associated with each of the three means. 
Again the formula used for variance ccmnutatvon will depend on whether 
or not the mean of this residual subset was found to be significantly 
different from zero. Form the F-ratios from the computed variances 
and list any failures of these ratios to fall within the acceptable 
limits given in Table 2. 

7. Repeat (S) and (6) for each Mission. Record in Table 7a 
or 7b the Number of Control Points from Datum No. 1 whose coordinates 
failed to satisfy either the t-test or the F-ratio test. 


8. Repeat (5) through (7) for each Major Geodetic Datum. 


3.1.4. Relative Geometry Point Residual Analysis 

1. Obtain the set of all residuals from photographic coordinates 
of Relative Geometry Point No. 1 obtained from Mission No. 1. This 
may be one, two, or three pairs of residuals from successive photographs, 
it may include residual pairs from photos made on later passes of the 


- same satellite over the same area, or there may be no residuals due 
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to the complete lack of photo coverage of this point by Mission 
No. 1. If there is no photo coverage of this Relative Geometry 
Point by Mission No. 1, go on to Mission No. 2, 3, hk, 5, or 6; 
whichever is the first mission on which this RGP was observed. 
Form the mean of these residuals and compute the t statistic. 
Form a list of all RGP's that give rise to residuals whose mean 
value fails to satisfy the t Test. 

2. Compute the variance of this residual sence: again 
using the equation indicated by the results of the above t-test. 
Compute the F-ratio associated with this variance and form a 
similar list of RGP's whose residual variance is different from 
unity as indicated by the F-ratio test of Table 2 

3. Repeat (1) aia -(0) using all other missions on which 
this point was observed. In the event that all observation residuals 
assocaited with this RGP from all missions fail to satisfy the Student's 
t-Test, or the variances from all missions fail to satisfy the F- 
ratio test, or both; this RGP should not be included in the final 
relative geometry point residual statistics. See below. 

lh. Repeat (1) through (3) for each relative geometry point. 
Enter in Table 10a or 16b, depending on which adjustment program 
was used, the total number of RGP's observed on each mission which 
failed to satisfy either of the tests of (1) or (2). Note, however, 


the exception stated in (3) and adjust the results accordingly. 


- 16 - 


1AtOLE VIA 





—OP-SEEREH A 


3.1.5. Treatment of Mission Dependent Systematic Errors 

Tables 3a through 8a and/or 3b through 8b provide a 
comprehensive summary of the results obtained from the individual 
t and F-ratio tests for the various kinds of residuals from each 
mission. Because the tests were based on a 10% confidence level, 
approximately 10% of the tests conducted are expected statistically 
to result in failures. However, if for a particular mission more 
than 10% of the Student's t Tests conducted resulted in failures, 
the mean of the residuals from this particular category 1s probably 
not zero. Likewise the occurrence of a greater than 10% failure 
rate in the F-ratio tests conducted on residuals associated with a 
particular mission is evidence of a variance different from unity 
for that mission. Either of these circumstances points to the 
likelihood of a systematic error which must be compensated for. 

1. If the mean of the residuals associated with a particular 
mission is significantly different from zero in more than 10% of 
the cases investigated, this mission is probably affected by one or 
more systematic errors. Factors which could cause this type of 
error are: A constant time bias in one or more of the orientation 
angles, an error in the calibrated values of focal length or principal 
point coordinates, or a timing error. The possibility of a timing 
error can be checked by examining the time biases for the various 
tracking stations that observed this mission. If each of the time 
bias parameters which were computed in the multi-mission adjustment 


are of about the same magnitude, there is probably a constant error 
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3.1.7. Treatment of Tracking Station Systematic Errors 

In the adjustment program, whether it be RECAP or TRACE-D. 
the coordinates of each tracking station have been corrected by 
allowing a set of station shift parameters. Furthermore, the 
RECAP Program solves for a time bias parameter for all observations 
from each tracking station of each mission. In spite of these 
attempts to remove systmatic errors from the ground tracking data, 
a bias due to a certain tracking site may be indicated in the results 
of the t and F-ratio tests recorded in Tables 3a, ha, Sa, and 6a in 
the case of the RECAP Program evaluation, or in Tables 3b, lb, Sb. 
and 6b from TRACE~D. The number of such tests conducted on the re- 
siduals from a particular station will be less than ten so it will 
be difficult to determine whether or not a single failure is 
significant. Again the magnitude by which the single test was failed 
must be taken into consideration before a decision can be reached. 

1. If the mean value of the residuals in observations made 
from a particular tracking station is different from zero, a 
systematic error is indicated. In the case of a radar station there 
is little that can be done to determine the exact nature of the error 
beyond verifying that the position of the station was allowed to ad- 
just without unreasonable restriction. There will be little lost in 
the way of useful information if all observations from this station 
are dropped from the adjustment. More can be said about the nature 
of the residuals from a tracking camera, because they have been separated 


into the directions of topocentric right ascension and declination. 
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in the vehicle clock, or more precisely, in the relationship between 
the vehicle time and the external time standard. 

If time does not appear to be a problem, the other factors 
mentioned above must be checked by performing a number of photo- 
grammetric resections in which the calibrated values of focal length, 
principal, point coordinates, and angular orientation are treated 
as adjustable parameters rather than known values. The condition 
equations to be employed are given in Appendix B along with a 
description of how existing subroutines can be used to form a large 
portion of the required resection program. The mean value of the 
parameter corrections obtained from at least 20 frames, well distributed 
in time and space over the entire mission, should be accepted as a 
bonafide correction to the calibrated value if the associated standard 
deviations compare favorably with those obtained for the calibration. 
Observations should then be corrected and the multiple orbit reduction 
repeated. 

2. If the variance of the residuals associated with a particular 
mission is greater than unity, the nature of the indicated systematic 
error is best determined by a transformation of the residuals to a new 
coordinate system -- the Intrack, Crosstrack, and Radial system. This 
transformation, applied only to the photogrammetric control point 


residuals, is accomplished through the formulas given in Appendix B. 
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If the transformed residuals are plotted as a function of time, 

they may exhibit a periodicity that is chavacteristie of a particular 
perturbing force. Multiple frequency effects may be present which 
would require that a complete harmonic analysis of the transformed 
residuals be employed: More likely is the occurrence of one or two 
dominant frequencies which can be compensated by rerunning the ml1ti- 
mission adjustment with additional periodic parameters in the empirical 
form for the orbital elements of this mission. Periodic variations 
in the radial residuals indicate the need for periodic parameters 

in Eccentricity and Mean Anonaly. Pertodic variations in the 
Crosstrack residuals can be compensated by periodic parameters in 
Inclination and Longitude of the Ascending Node. Periodic parameters 
are required in Eccentricity, Mean Anomaly, and Argument of Perigee 
to compensate for periodic variations in Intrack residuals. 

Another systematic error that may be discovered from the 
residual plot is a discontinuity in the orbit resulting from an 
inconsistancy in the correlation of the vehicle clock to the external 
time standard. There may be other causes for such a discontinuity 
such as the force applied due to the ejection of a package from the 
vehicle or the sudden change in atmospheric density which accompanies 
a large solar flare. When a discontinuity is detected, its cause is 
immaterial unless more information can be obtained. The removal of 
this type of systematic error requires a readjustment of the data, 

_ treating observations before and after the discontinuity as if they 
were made from different satellites. Two sets of orbital parameters 


are then required to describe the path of the vehicle on this single 
19 
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mission, although the number of parameters in each set can probably 
be reduced because of the shorter time span to be covered. 

If, on the other hand, the trnasformed residuals appear to 
be randomly distributed in time, the suspected systematic error may 
not exist. The "a priori" estimate of the photo-coordinate measurement 
variances may have been too small causing a larger variance in residuals 
that have been weighted by this factor. Such an assumption can 
certainly be made if the ground tracking data residuals for this 
mission do not also have a variance larger than unity and/or if the 
mean of the control point observation residuals was not significantly 
different from zero. If these conditions exist, the value of s2 com- 
puted in this test may be substituted for the "a priori" variance 
estimate used in the weighting of the DAFF photo measurements from 
this mission and the multiple orbit reduction rerun. 

3. If the variance of the residuals associated with a particular 
mission is less than unity, there is probably an error in the weighting 
factor applied to the observations of that mission. If the observations 
are in fact significantly more precise than they were expected to be, 
then this increased precision belongs in the covariance matrix of the 
parameters rather than in the variance of the observation residuals. 

In the adjustment of a homogeneous set of observations the final 
variance can be used as a scaling factor applied to the covariance 


matrix of the adjusted parameters and no further computation is necessary. 
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This method was used by the DOI-h Program. In the case at hand 
however, only a subset of the residuals are so distorted. It is 
better, therefore, to re-examine the "a priori" variance assigned 

to the control point measurements from this mission. particularly if 
analysis of the ground tracking residuals did not verify the apparent 


mission related bias. 


3.1.6. Treatment of Datum Dependent Systematic Errors 

Since all tracking stations were considered to be free points, 
independent of any geodetic datum, the only residuals that might re~ 
flect datum biases are those from photogrammetric control point 
observations. The results of the statistical tests applied to these 
residuals are summarized in Tables 7a and 8a or 7b and 8b, depending 
on which of the adjustment programs is being evaluated. Again a 10% 
failure rate is expected, but in this case fewer than ten tests were 
conducted on residuals associated with a particular datum. If only 
one failure occurred, the magnitude of the departure must be con- 
sidered in deciding whether or not there is sufficient evidence of 
a datum related systematic error to justify the time and manpower 
required to perform the further testing described in the following 
paragraphs. 

1. If the mean value of the residuals associated with a 
particular major geodetic datum is significantly different from zero, 


a systematic error is indicated which may be due to the transformation 
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of points on that datum to the World Geodetic System. Since 
translation of the datum origin was to be included in the parameter 
set of the multi-mission adjustment as accomplished by either 

RECAP or TRACE-D, a non-zero mean for these residuals is not likely. 
Therefore, the computed corrections to the datum origin should be | 
examined to establish that the datum shift adjustment did in fact 
take place. The next step should then be to check the variances that 
were applied in advance to the datum shift parameters. It would seem 
that these parameters were unrealistically restricted by the assignment 
of too large a weight. This weighting factor should be relaxed and 
the adjustment repeated. 

2. <A systematic error associated with control points from a 
particular geodetic datum should be suspected if the variance of the 
residuals from observations of those points is significantly larger 
than one. The errors within any major datum, with the possible 
exception (at thepresent time) of the Nan King Datum, should be 
quite small in comparison to the random errors of observation. 
However, there are map series within a given major datum that may be 
systematically distorted with respect to the rest of the maps on the 
same datum. Since there has been no effort in the past to classify 
control points by map series, it would be difficult to subdivide the 
residuals on this basis. If it is possible to further segregate the 


residuals according to map series, the offending series can be eliminated 
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from the adjustment. However, it may be impossible or impractical 

to determine at this stage which control points came from a certain 
series. The residuals from this datum should then be grouped according 
to latitude and longitude in order to determine in what manner they 
may be systematically displaced within the datum. 

If one geographic area is the source of the largest residuals 
and if this area is covered by a single map serles, it would be 
advisable to try to locate another independent map series which covers 
the same area. New values for the control point coordinates could 
then be obtained for use in a repeat of the mltiple orbit eduction, 
It is more likely, however, that themap series used was the best 
one, or the only one available at the time of collecting the data. 

If such is still the case, the contaminated observations should be 
omitted from the data set and a new adjustment performed. 

Another situation which should be evident from the geographic 
grouping of residuals is a radial distortion of all points in the 
datum. In this case observations with the largest residuals would 
arise from points near the edges of the datum. Errors arising from 
this situation could be corrected by a new transformation formula 
which would include a scale factor in the relationship of the particular 
datum to the World Geodetic System. Lacking such a formula it is | 
probably sufficient to drop all control points on this datum that fall 
beyond a certain maximum radial distance from the datum origin and 


then readjust. 
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If no systematicity can be detected in these residuals, 
the weighting factors applied to the observations may be unreal- 
istically large. These weights, applied to the observations, should 
not be confused with the "a priori" weights assigned to parameters 
such as those discussed in section (1). Incorrect weighting of a 
group of parameters causes a systematic error by forcing other 
parameters to compensate for errors in the restricted set. Errors 
in the weights applied to observations may cause a systematic error 
by forcing the model parameters to compensate for errors in the 
observations, if the set of such incorrectly weighted esmeeiens 
is large. If they are a very small set, the variance associated with 
their residuals will be too large. In this case s* should be substi- 
tuted for the "a priori" variance of this observation set and the 
adjustment repeated. 

3. If the variance in the residuals associated with any one 
of the geodetic datums is significantly less than unity, the control 
points from this datum have probably been assigned too large a 
variance (too small a weight). Perhaps the maps from which these 
points were scaled were at some time in the past downgraded to "Class 
B" because they lack the cultural detail required of a "Class A" map. 
The accuracy however might meet "Class A" standards and the variances 
assigned to points scaled from them would be incorrectly large due to 
using the accuracy standards of "Class B". The possibility of this 
type of weighting errors should be investigated. It is advisable that 
any new variance be verified before it is used. If this verification 


2 


is not practical, the computed s“ value may be substituted for 


the assumed observation variance so long as the mean of the residuals 


is nearly zero. 
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If only one set of these residuals have a mean value different from 
zero, the position of the tracking station should be suspected of 
being in error in that direction. Since such an error should have 
been corrected in the adjustment, the computed corrections to the 
tracking camera position should be checked. It is possible that too 
stringent a weighting factor was placed on the position of this tracker. 
If not, and if no other information about the nature of the station 
bias is available, the observation data from this station can be 
dropped from the adjustment. 

2. A variance larger than unity for the subset of residuals 
from a particular tracking station may be an indication that the 
data from that station is affected by a bias. One such bias would 
result from the failure of the pre-processing programs to completely 
compensate for known systematic errors such as atmospheric refraction. 
This type of bias could be detected by plotting the residuals from 
each pass of the satellite over the station as a function of time. 
If the residuals increase significantly near the beginning and end 
of each pass over the tracker, then the error model used in preparing 
this station's data is subject to question, 

However, if no systematicity is apparent in this set of 
residuals and if the mean value is near zero, the assumed variance 
in the observations from this station is probably in error. As stated 
in previous paragraphs the application of a weighting factor based 


on an "a priori" estimate of the observation variances that is too 
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small will cause the residuals in these observations to have a 
variance greater than one. If this situation is encountered, 

s¢ may be substituted for the previously assigned observation 

variance for all data from this station and the m1ti-mission 

adjustment repeated. 

3. If the variance in the residuals from a given tracking 
station is significantly less than one, it can be assumed that the 
variance assigned to the observation data from this station has been 
chosen too large. At this time the best estimate of the observation 


variance is 3°, which should be used in repeating the adjustment. 


3.2 Propogation of Random Errors 
It is assumed at this point that all systematic errors which 


arise from the major sources of bias have been reduced to an insignif- 
icant level. The only errors affecting the vehicle positions obtained 
from the multiple orbit reduction are the random errors of measurement 
and/or recording, and those systematic errors which do not cause 
detectable biases in the subsets of residuals discussed in the last 
section. In this section the systematic errors will be assumed non- 
existant unless inconsistancies are found in the propogation of random 
errors which indicate that this sdanmseen is not justified. Under 
this assumption the random errors in the exposure station positions 
due to the orbit determination and the photogrammetry, when propogated 


into the computed positions of check points, give the expected accuracy, 


ay 


as opposed to precision, of the computed check point position. If 
the positions of these check points are known with relatively small 
errors, then the discrepancy between the true and computed position 
must not be significantly larger than predicted by the statistical 
analysis of the random errors, if the hypothesis of no systematic 


errors is to be accepted. 


3.2.1. Selection of Check Points 
3.2.1.1. Geodetic Control Points 

Figure 1% shows the locations of 39 areas in which geodetic 
control points have been or are to be selected for use as check 
points. These areas have been chosen because they provide a good 
geographic distribution and because it is known from previous tests 
that most of them contain a number of photo-identifiable geodetic 
control points compatible with the requirements stated below. Ten 
to twenty check points are to be selected in each area. This number 
can be reduced as identification becomes more certain -- three points 
being sufficient if positively identified. If two geodetic control 


points are closer together than 20 kilometers, they may be counted 





* The selected areas of geodetic control are presented in Figure 1 
on a homalographic projection of the world (interrupted for the 
continents) which is a part of the Goode Base Map Series published 
by the Department of Geography, University of Chicago by whose per- 
mission it is used in this report. 
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as separate points for purposes of obtaining the required number in 
the area, but some means should be employed of identifying these 
points as highly correlated. 

Each point is to be identified on all photographs on which 
it can be found. This mst include photos from more than one mission 
or at least from more than one pass on a single mission, although it 
is not required that all points in a given area of geodetic control 
fall on any single photograph. In nearly all cases there will be two 
consecutive photographs on which each point appears, and both of these 
should be used. This means that most points will be identified on a 


minimim of four photographs. 


3.2.1.2. TRANET Stations 

There are approximately 50 TRANET stations that have been 
located to geodetic accuracy by Doppler observations made from these 
stations of one or more of the TRANSIT satellites. Less than half of 
this number is identifiable on the DAFF photography, but if surrounding 
landmarks are used in transferring the station location from large 
scale aerial photographs to the DAFF in much the same way in which 
an area match is accomplished, then approximately half of these 
stations should be usable as check points. Stations that are of 
particular interest because of their geographic location are located 
at Thule, Greenland and MacMurdo Sound in Antarctica, but unfortunately 
these stations do not appear to be identifiable on the DAFF and no 


panoramic photography is available of either of these areas. The 


- 30 - 


HANOLE VIA 


—FAR-OrpArr rire CONTROL system oui 


pacific island stations are also of major interest because they 

are the farthest away from any control points that may have been 

used in the adjustment. It appears that many of these island stations 
will be usable and should be used, even though the exact site of the 


station can only be approximately located (within 300 or 00 feet). 


= 3] < 


HANDLE VIA 


AEN KEHHOLE— 


{i CONTROL SVcTEM 


ONLY 





_Tpp crenre itr — 


3.2.1.3. ‘Tropo-Scatter Stations ~ 


Since there is neither geodetic control nor TRANET station 
in North-central Siberia, and because of the importance place on 
the accuracy of point positioning in this area. it is advisable to 
use as check points any landmark for which coordinates can be 
obtained regardless of the uncertainties associated with this data. 
Approximately 31 Tropo-scatter stations are known to exist in this 
area dnd the Gauss-Kruger coordinates of most of them are available. 
These points can be placed within the World Geodetic System with 
about as much reliability as many geodetic control points in the far 
east whose coordinates on Nan King Datum are available. However, the 
identification of most of these stations is subject to serious doubt 
because several. construction sites separated by many hundreds of feet 
are found in the general area in which the station is known to exist. 
Each separate site is well defined, but it is impossible to ascertain 
which of these is the true station. 

In such cases all possible station sites should be selected 
as separate points, and each treated as the true station. If any one 
of them is found to fall within an acceptable miss-distance of the "true" 
position of the Tropo-scatter station when intersected from the DAFF 
photography, then a partial verification of the accuracy of the reduction 
as it affects this particular area has been obtained. On the other hand 
a failure to obtain the statistically predicted agreement between computed 
and "true" positions of the station should not be considered a failure 
of the orbital model to fit this part of the world unless it is observed 
that most of the discrepancies in Tropo-scatter stations are in the 


same direction. | - 32 - 
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3.2.2. Identification of Check Points 

The methods used in finding and marking the check points on 
the DAFF photography will depend to a large extend on the circumstances 
surrounding the particular point, and should therefore be left up to the 
operator. It may be better in one case to identify the point on a pan 
photo first and transfer the identification stereoscopically to the DAFF. 
However, many points may fall in areas where no panoramic photography is 
available, or they may fall too near the horizon on the only usable pan 
photographs. If the operator makes a consciensious effort to maintain the 
highest degree of accuracy, his judgment as to the most accurate method of 
identification of the check point should be relied upon. 

While precision is generally associated with the measurement phase. 
identification and marking of the point is probably the largest source of 
error in the measured coordinates unless the point is measured (without 
being marked) on a stereo-comparator. It is therefore necessary for the 
operator who makes the identification and marks the image to make a very 
careful assessment of the accuracy of his work. This will probably be in 
the form of an image clarity rating which can later be assigned a weighting 


factor on the basis of repeatability tests. 


3.2.3. Measurement of Check Points 

Measurement techniques which produce high standards of accuracy 
have already been developed in the procedures for evaluation of the in- 
dividual missions and these techniques should be rigorously followed. In 
particular all twenty-four shrinkage and fiducial marks should be measured 


twice and a third reading taken in any case in which the first two do not 
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agree within five microns in the case of contact positives, or twelve mic- 
rons in 1.8x enlargements. The check point images, or marks indicating 
the locations of these images, should also be read twice. If the images 
have been marked by drilling or some other means which provides a small, 
symmetric target, the taking of a third reading should be based on an 
agreement criterion similar to that used for fiducial marks, but adjusted 
in magnitude to account for the greater difficulty in centering on this 
target. If the images are not marked in advance, a minimum of five inde- 
pendent measurements should be made and an image clarity rating assigned 


by the comparator operator. 


3.2.4. Processing Raw Measurement Data 

| Certain systematic errors in the photo coordinates mst be removed 
before these data may be used in any photogrammetric intersection program. 
Among these are radial and tangential lens distortion and film shrinkage. 
The same corrections that were applied és the operational photography should 
be used here with two exceptions: (1) Tangential lens distortion corrections © 
should be applied if the calibration data indicates that these are significant, 
and (2) Film shrinkage should be corrected by applying an eight-parameter 
transformation. The use of an eight, rather than a six, parameter trans- 
formation 4s predicated on the assumption that the measurements will be made. 
on enlarged positive transparencies rather than contact positives. The tilt 
datnoduced in the enlargement process can be compensated by the two extra 
parameters. If the enlarger has been show by calibration to be free from 
these errors, or even if contact prints are used, the eight parameter trans- 


formation is preferable because there is some evidence that a tilt has been 
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introduced into some of the frames from at least one of the missions 


by the failure of the camera pressure plate to seat properly. 


3.2.5. Intersection of Check Points 

Having at hand the corrected photo coordinates of the conjugate 
images of a check point, the positions of the camera stations from which 
the exposures were made, and the orientation of each exposure; the com- 
puted position of the check point can be obtained by the standard photo- 
grammetric intersection technique. The procedure given here will differ 
from the classical intersection because the geocentric position of each 
exposure station as well as the orientation angles of each exposure are 
treated as observed variables with covariances known between the coordinates 


of one exposure station and those of all others on which the point is imaged. 


3.2.5.1. Covariance Matrix of Exposure Station Positions 

The exposure stations from which the check points are to be inter- 
sected can be obtained from the ephemeris generated by the orbit adjustment 
program. However, the covariance matrix output with the exposure station 
coordinates does not include covariance between these coordinates and those 
of any other station. There is instead a better source for this data. On 
the final iteration of either of the orbital programs the coefficient matrix 
of the Normal Equations is inverted in order to obtain the covariance matrix 
associated with the computed orbital parameters. RECAP forms the full 
covariance matrix which accounts for the correlation between the parameters 


of one mission and those of another. No such between-missions covariances 
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can be obtained from TRACE without a program modification, bdut 
these terms are expected to be small and can probably be neglected. 
However, the more general case will be treated here and the covariance 
terms can be assumed to be zero if they are not available. 

The matrix of the partial derivatives of the positions of 
all camera stations to be used in the intersection with respect 
to the orbital parameters of all missions can be formed by using 
the appropriate subroutine(s) of the adjustment program (Subroutine 
PARPAT in the case of the RECAP Program). This is the P matrix in 
the formas given in the third part of Appendix B. If the covariance 
matrix of the orbital parameters from all missions is pre-mltiplied 
by P and post-multiplied by pr the resulting product is the covariance 
matrix of the exposure stations from which the check point is to be 
intersected. This matrix will be required in the weighting of the 


observed variables used in the intersection. 


3.2.5.2. Covariance Matrix of Orientation Angles 

The orientation matrix of each photograph was computed by 
Program OREAXE before the multi-mission adjustment was started. In 
the course of the orbit adjustment the orientations of all exposures 
were treated as known, because the inclusion of these quantities either 
as observed variables or as parameters would so complicate the 


calculations as to render them completely impractical. This assumption 
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of no error in the roll and yaw angles of the terrain camera is 
justified because these angles have been found to have a standard 
deviation of 5 seconds of arc which is well within the noise level 
of the system. The error-free assumption is nearly valid for the 
pitch angle since the 20 are seconds standard deviation that char- 
acterizes this quantity contributes an sere of about 100 feet on 
the ground. However, in order to be completely aware of all errors 
affecting the final results of the check point intersections, the 
errors in orientation angles of each photograph should be propogated 
into the accuracy estimate of the check point. 

One of the options of the OREAXE Program, known as ORESUM, 
enables the user to obtain the covariance matrix of the elements of 
orientation of the stellar exposure. This covariance matrix mst 
be scaled by the measurement variance (also output under this option) 
converted to inches squared. This transforms the units of the 
covariance matrix to radians-squared. 

Since the orientation of each DAFF exposure is independently 
determined from the corresponding stellar frame, there will be no 
correlations between the orientation angles of one frame and those 
of any other. Hence the covariance matrix of the observed orientation 
angles of all frames used in intersecting a given check point will be 
quasi-diagonal, consisting of 3 x 3 submatrices. 
3.2.5.3. Covariance Matrix of Photo Coordinates 

In the process of selecting, identifying, and measuring the 
check point images as described in sections 3.2.1. through 3.2.3., 


estimates of the accuracy of the image coordinates were obtained. 
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These accuracy estimates are to be put in the form of variances 

and used as the diagonal elements of the photo coordinate covariance 
matrix. Since each measurement should be independent, the covariance 
matrix of these measurements will be diagonal so no covariances need 


be deduced. 


3.2.5.4. Propogation of Errors to Check Point Positions 

There are only three parameters to be corrected in the 
intersection of a check point -- the geocentric coordinates of the 
check point. This initial approximation of these coordinates can 
be obtained by scaling the position from a small scale map or the 
true position can be used because the final coordinates will not 
depend on the starting values, except that a solution cannot be 
obtained if starting values of the parameters are too far away 
from the true values for corrections to be linear. Section 3 of 
Appendix B gives a detailed description of the intersection process 
and all of the required formulation. 

The propogation of random errors of observation to the 
intersected check point in order to obtain an estimate of the accuracy 
of its computed position requires tnat the observations be weighted 
according to the covariance matrices discussed in sections 3.2.5.1. 
through 3.2.5.3. The formation of the weight matrix, or more precisely 
the inverse of the weight matrix is given by equation (34-B). The 
covariance matrix of the computed check point position, obtained from 


inverting the Normal Equation coefficient matrix, gives the predicted 
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accuracy of this position. However, because covariance will exist 
between tha coordinates, this matrix is difficult to interpret. 
The next section shows how this matrix can be turned into a set of 


numbers whose significance is mich more easily realized. 


3.3. Analysis of Results 
Having computed the position and variance-covariance matrix 
of the check point, accuracy statements can be made and checked 
against the true check point position in order to determine whether 
or not all systematic errors in the orbital positions have been 
reduced below the random error noise level. Equation (50-B) is the 
expression for an ellipsoid of constant probability centered on the 
computed check point position. Note that from the form of this 
equation the axes of the ellipsoid will not be parallel to the 
coordinate axes unless all off-diagonal terms in the variance- 
covariance matrix are zero. Analogous to the probability statements 
generally made concerning univariate normal distributions, i.e., 
there is 90% probability that the true value is less than 1.65 times 
the standard deviation away from the computed mean, there is a 90% 
probability that the true point will be inside the ellipsoidal sur- 
face defined by setting S equal to 6.25. 
If the true coordinates of the check point are entered in 
equation (50-B) in place of the variable coordinates X,Y, Z, then 


the resulting value of S should be less than 6.25 for approximately 


- 39 - 





HANDLE VIA 


- FOR-SECR ET pu | 
> 
— 


90% of the points tested. If it is not, and the coordinates amines 
to be the true position are reliable, then some contamination by 
systematic errors must still remain. The procedures of section 
3.2 should be rechecked to be certain that they have been completed 
accurately. The next step would be an extensive program of testing 
further subsets of the residuals by the same methods dined in section 
3.2. What these subsets might be will depend to a large extent 
on what categories the residuals can be separated into most easily, 
unless there is some evidence that indicates that a particular source 
of error is responsible. 

If approximately 90% of the check points do fall within the 
90% probability ellipsoid, and if the 10% failures appear to be 
randomly distributed over the areas used, ther the intersection 
equations of Section 3 of Appendix B can be used to compute the 
coordinates of unknown points with a high degree of confidence that 
the resulting covariance matrix will be a reliable accuracy estinator. 
However, this covariance matrix must be transformed into statistics 
that are more easily interpretable in terms of the system requirements. 
The first step will be the rotation of the Geocentric coordinate 
covariance matrix into a local coordinate system. This rotation, 
described in Appendix B, allows the elevation variance to be treated 
separately from the horisontal variances. This is a desirable separation 
because the horizontal accuracy is expected to be mich better than the 


elevation accuracy. 
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If the elevation accuracy is extracted from the covariance 
matrix, the remaining 2 x 2 will be the projection on the horizontal 
plane of the error ellipsoid. The 90% assurance level for elevation 
is obtained immediately by multiplying the square root of its variance 
by 1.645. The horizontal accuracy must be stated in terms of circular 
error which requires more manipulation. First the eigenvalues of the 
covariance matrix -- the 2 x 2 associated with the horizontal position 
must be calculated. A subroutine given in Appendix C can be used for 
this purpose. The eigenvalues are important because they are the semi- 
axes of the error ellipse in the Hoeteuntal plane. The square root of 
the ratio of the smaller to the larger eigenvalue is now used as argument 
for obtaining a value C from Table 11. The radius of the 90% assurance 
circle is then given by the product of C and the square root of the 
larger eigenvalue. 

The radius of the 90% assurance circle is a single number which 
characterizes the horizontal accuracy of a particular terrain point. 
This statistic can be computed for every check point and will probably 
be found to vary with latitude and longitude. Sufficient check point 
areas have been employed so that a map of the world showing contours of 
equal 90% probability circle radii can be constructed. It would then be 
possible to tell at a glance the horizontal accuracy that can be expected 


from DAFF intersections of terrain points in any area of the world. 
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Although the complete removal of systematic errors is a nearly 
impossible task, the reduction of systematic effects on the accuracy 
of orbital positions to an insignificant level should be accomplishable 
within the procedures outlined in this test and evaluation plan. Having 
so reduced the systematic errors, the statistical equations generally 
employed to obtain estimates of precision may be used in predicting the 
accuracy of computed results. 

With a serizs of check point areas which are well distributed 
over the land suffaces of the earth, statistical statements of expected 
accuracy can be verified. If the accepted geodetic positions of these 
check points are correct, the accuracy verification will indicate whether 
or not residual systematic errors remain, and if they do not the computed 
precision can be accepted as a reliable means of predicting the accuracy 


of any future point locations obtained from this material. 
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It is recommended that this test and evaluation be applied 
to the adjusted DAFF Missions as soon as these are available. While 
time spent in the detection and removal of systematic errors by the 
methods outlined in Section 3.1 does not produce improvements that are 
readily noticeable, the greatest emphasis should be placed on this part 
of the project, since the subsequent steps are so highly dependent on it. 

There is the distinct possibility that the results of this 
evaluation will show that while accuracy of ground point location from 
the DAFF photography is higher than predicted by the more pessimistic 
critics of the system, it does not meet the tolerances set for it. 
Even if the DAFF photography used with the best data reduction system 
does meet present day tolerances, these tolerances will soon be tightened 
and a more stringent requirement will initiate a program of increasing 
the accuracy, either by adding more and better control or launching another 
series of satellites or both. It is therefore recommended that the 
ultimate accuracy of the existing material be investigated by simulating 
the effects on the point location accuracy of such new inputs as: more 
control, more accurate control, a better distributation of control, etc. 
Such a study will determine whether it 1s worthwhile to concentrate on 
the material at hand or supplement this material by further satellite 
missions. As a byproduct of this study the optimim amount, accuracy, 
and distribution of control to be employed will be determined. If the 
improvement of control to be used with the existing material is indicated 
as the better approach to meeting geodetic accuracy requirements, a plan 
for control enhancement will be easily formulated from the data obtained 


from this simulation study. 
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1. _ Resection Equations. 
Let the position vector of the camera station be denoted 


(X, Ye Ze)? and the position of each ground point (Xy Yy 24)? where 
i=1, 2, ...a. These vectors are both in the geocentric 
coordinate system with the X-axis in the Greenwich Meridian. The 


Colinearity Condition Equations are 
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where the coordinates subscripted i are refer to the image of ground 


point i, those subscripted p are the principal point coordinates, 


f is the terrain camera focal length, and 
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in which the my; are the elements of the orientation matrix of the 
terrain photograph. | 


The linearised form of the condition equations will be given by 
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where, because in this application the photo coordinates, the 


control point positions, and the camera station positions are 


all treated as observed variables, the matrices and vectors 


involved will be 
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Let of, be the 2 ; SCRE. of the photo 


XY+ 
coordinate measurements of image point i, o'EYZ4 be the 3 x 3 


covariance matrix of the coordinates of the ith control point, 
o 
and o XYZ the 3 x 3 covariance matrix of the camera station 
Cc 
coordinates. The covariance matrix associated with the observed 


variables will be given by 
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in which the indicated partial derivatives can be written as 
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are the factors entering the earlier partial derivatives. 
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Note that the A matrix is a 2n x (2n + 3n + 3) and the covariance 
Q 
matrix o is square and of order 5n + 3. The matrix product W' = 


Ao’ AT, which 4s a 2n x 2n, can be formed directly rather than 


storing the A matrix. It is easily verified that 
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for the diagonal elements, and 
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The Normal Equations (15-B) are solved iteratively for the 
parameter correction vector &. The inverse of the coefficient matrix 
BT (Ac? aT) B will then be the covariance matrix of the adjusted 
parameters. This matrix should provide a good indication whether the 
adjusted values for the calibration parameters are expected to be 


superior to those previously used. 
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2. Residual Transformation Equations 


The transformation of the residuals in photographic 
coordinates of control points to the equivalent residuals in the 
Radial, Intrack, and Crosstrack position of the camera station 
may be accomplished by the equation 

Ax, 
A Radial byy 


AXp 
4 Intrack = Q Ayo (18-B) 
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AXn 
4Yn 
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where the Axy and Ay; are residuals in the photo coordinates of 
the control points imaged on a sinzle photograph, the transformed 
residuals A Radial, A Intrack, and A Crosstrack apply to the 
position of the camera station, and the transformation matrix 


Q is given by 
a 
QQ = (woTuv)- yTot (19-B) 
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is the matrix of the partial derivatives of the co-linearity 
condition equation with respect to the camera station coordinates 


as given in equation (9-B),and 
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The elements of these matrices can be obtained from the subroutine 
in the RECAP Program which forms the required derivative, i.e., 
Subroutine BXYZ for elements of U, and Subroutine PARPAT for the 
partials required in V. A similar Subroutine is available in the 
TRACE-D Program for computing the partial devivatines required in 
the V matrix, but since the colinearity condition equation is not 
used in this program the elements of U must be obtained from RECAP 
or from separate computation. 

For completeness the partial derivatives of the camera 
position with respect to the orbital elements, required in the 
formation of V follow. These formulas can be used if separate 


programs are to be used rather than incorporating existing subroutines. 
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where 
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Be = R(-sinfcos \ ~ cos£ cos 1 sin }) 
3a) 

AYe = R(-sin# sin ) + cosf cos i cos 2) 
ao 

32, = R cosf sin i 

Ca 

4X = Ze sin 

— Cc 

oy 

AY = - Zz, cos 

T4 

3Ze «C= «CR cos i sink 

ay 


R = a(l -e cos £) 


dL < @O * Vv 


E = M+te sink 
sin v = a(l -e*) sinE 
R 


cos v = af{ cos E - e) 


(22-B) 


(23-B) 


(24,-B) 


(25-B) 


(26=B) 


(27-B) 


and a, e, i, w, >, and M are the semi-major axis, eccentricity, 


inclination, argument of perigee, longitude of the ascending node, 


and mean anomaly of the orbit respectively. 
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3. Intersection Equations 


The intersection equations following the same line of 
development as the resection equations given in the first section 
of this appendix. Let the first approximation of position of the 
ground point (check point) be (Xp Yep a" and the positions of the 
camera statdons from which the check point was observed are 
(Xoq Tog Zia) where 1 = 1, 2, ... on. The co-linearity condition 


equations will be 


x + f(t = €X 
4 7 4 


- (28-B) 
yy + fo = ey4 


where x and y are the coordinates of the check point image on the ith 


photograph and 


i . ’ i 
Uy Mir Mie ms | Xoq - x, 
vy, | 7 My Mae Mos You - Ye (29-B) 
. i i i 
Wy May Mao Mas Ze4 = 2g 


in which the Mak are the elements of the orientation matrix M4 of 
the ith photograph. | 

In order to form the weight matrix for the observed variables 
the covariance matrices of each of the observed quantitites met be 
obtained. The covariance matrix of the several exposure station 


positions can be formed from the covariance matrix of the orbital 
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parameters as obtained from the adjustment program. This matrix 


will have the form 


op P, i. 
“bP, (pp, °° Pm 

Be i (30-B) 
PmP, "PaPp PP 


where PsP, is the covariance matrix of the orbital parameters of 

the ith mission and P,P is the matrix which expresses the covariance 
| J 
between the parameters of the ith and jth missions. The propogation 


of covariance to the exposure stations requires the matrix 


(Xe, Yor 2c.) (Xe, Yo, 2c,) « + - (Xe, Ye, Ze,) 


oP, 3P 2 m 
a(Xeo Yeo Zee) a(x Yoo Zee). %. =: 6 One Yoo: Ze) 
ae 1 aPp aPm 


3(Xon Yon Zen) (Xen Yen Zen) + + + 3(Xen Yon Zen) 
aPy — a 


in which each submatrix is the set of partial derivatives of the 
particular exposure station with respect to the orbital parameters 
of a specific mission. It is obvious that an exposure station is 


a part of only one mission and therefore independent of all others. 
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Hence only one of the indicated submatrices in each row of P 
will be nonzero. All other submatrices in that row are showm 
here only to indicate the number of zeros required to fill out 
the matrix. Specifically, if the first mission is characterized 
by p, parameters, the second by pp, and the ith by py; and if the 
jth exposure station occurred on the ith mission; then A(Xo4 Yo3 204) /AP, 
is a 3 xX py matrix of partial derivatives which can be obtained from 
the subroutine used in forming the system Normal Equations (Subroutine 
PARPAT in the case of RECAP). The other submatrices in that row, 
A(Xo4 Yo3 Zo3)/8Pk for all k except k = 1, will be 3 x py, matrices 
of all zeros. 

The covariance matrix of positions of the set of exposure 
stations that will be used in intersecting the check point can now 


be obtained from 


(¢) bs T | 3 
Cvy7 PoP (31-B) 


The covariance matrix associated with the orientation angles 
of each stellar exposure is obtained from Program OREAXE if the proper 
option is used. This matrix mst be mitiplied by a scale factor 
derived from the measurenent variance (output in the form of a standard 
deviation) in order to convert the units to radians squared: 


2 
Or 


< -@r) 
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Y dae Be el 


rap creat pure 

where o,, is the measurement standard deviation, aa! is the covar- 
dance matrix output from OREAXE and oe is the covariance matrix 
of the orientation angtes as required in forming the weight 
matrix. Since the orientation of each DAFF photograph is determined 
from the corresponding stellar frame, there will be no correlation 
between the orientations of pairs of photos. The required covariance 
matrix obs of the orientation angles of all frames used in the 
intersection will therefore be quasidiagonal, consisting of a series 
of 3 x 3's down the principal diagonal. 

The covariance matrix of the image coordinates oxy will be 
diagonal, consisting of the variances in the image coordinates as 


determined at the time of identification or measurement. 


Hence the covariance matrix of the observed variables will be 


o. 0 0 
xy 
o 
gg? = 0 Cxyz 0 (32-B) 
0 0 oaks 


and the matrix A of the partial derivatives of the linearized 
condition equations with respect to the observed variables will be 
of the form 


A = E Ayyy hats (33-B) 
so that 


Ao®al = Oxy + Ayys Ory ‘ae + Aags nbs Ares (34-B) 
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pte EY) 0 —¢ 0 
C; tc, Ze) 
0 A(EXe Eo) 0 
A(Xce Yeo Zce) ibe 
Ayyz a « ° 35- ) 
A(EXy Eyn) 
is a 2n x 3n in which each submatrix is given by 
2 
oo 0 muy /Wy 
m4 
a(exy cys) = f , | (36-B) 
) ed Toa Ze) 0 iL. v4 /Ws 
wa 
and 
a{ex, ey;) — 0 0 
d{a, 5, sz) 
Aare 0 3(eXe Eyz) 2... 0 
a Gg “2 8e ; 
ie meme) 
Ady, Sy Sy 
is also a 2n x 3n in which 
i 0 “uy / wy 
O(exy Ys) 3 Wy A(usy ve wa) (38-B) 
A(aq 84 sy) Alas 04 S4) 
> Ale? aE 1 ~v4/wa + i i 
Wy 
B-13 
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The orientation matrix M, of the terrain frame is obtained 


from the stellar camera orientation matrix by the rotation 


M, = R Hy 


(39-B) 


where R is the matrix which was obtained in the calibtation of 


this instrument and H is the stellar orientation matrix output 


from OREAXE 


hoy 
hy 2 
Nig 
Nex 


Hee 


{in which the elements are 


= - cos s sina + sin s cos a sin & 


= + cos 
= - sin 
= ~ sin 
= + sin 
= + cos 
= + cos 
= + sin 


= + sin 


s 


8 


a 


cos 
cos 
sin 
cos 
cos 
cos 


cos 


a + sin s sin 1 sin 

& 

a@ - cos s cosa sin & 

a - cos s sin a sin 6 (40-B) 


& 


) 


6 


Because of the relationship (39-B), equation (29-B) can be written 


My 


v, {* R Hy 


WE 


Xuy - x 


& 
Tox - Ye (41-B) 
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Using the matrix differentiation technique described in refer- 


ence 11 the required partial derivatives can be obtain from 


uy Koy -~ X 
2 ou : 
As Va 4 R Ss Yoq - Yg 
Wy | Z el 7 Ze 
oO -1l Q uy 
-R {1 0 oO jri) vy, (42-B) 
0 Oo 60 Wy 
a Uy 1 0 0 ys Uq 
BS V4 Sd ( T = he? ) R 0 0 -hoy RE Va (4 3-B) 
wy hy 3 hos 0 Wy 
uy 0 hss “Noa Uq | 
a v, |= Ri-hsz 0 mhs| RP | vy (hu-B) 
aa 
Wy hes -hyz 0 Wy 


The matrix B of the partial derivatives of the observation equations 
with respect to the check point position is given by 


A(ex, ey,) 
3(Ke Yg zg) 


B= | a(ex, £¥s) (45-B) 
g tg 4) 
a(exy Yo) 
g +g “8 
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where again 
A(ex; cys) = - F(exy ey;) (46-B) 
ag Yp t,) (Ker Loy 2ct) 
The Normal Equations to be solved are then 
o,T\~~ Pe ry ee 
Bl (ao°A*) BD = B’(Ac°A') € (47-B) 


in which 
.% (48-8) 


D = (AX, AY, AZ 


g g g 


is the vector of parameter corrections, and 
7 T 
€ = (€x, EY, Xe EVo « « + EXm EYn) (49-B) 


the discrepancy vector, are the only variables not defined in 
equations (32-B) through (6-B). Solving this equation iteratively 
until the parameter corrections become negligible will result 

in the most probable position of the check point, and the inverse 


of the Normal Equation coefficient matrix. 


ro) = -l 
Ty = Bl (Ac AT) 13 


will be the covariance matrix associated with this position. 
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4. Error Analysis Equations 


The quadratic form 
X -X 


g 
K-xX y-y¥, z-2.| Bl(aoaT)“B | ¥- | = 5 (S0-B) 
g g g 
Z- Zp 
where Xp: Ty» and Lg are the computed coordinates of the check point 


position and B' (Ac A')-1B is the coefficient matrix of the normal 
equations employed in the solution for the check point position, is 
the equation of an ellipsoid of constant probability. That is, if 
S is set equal to 6.25 the expression (50-B) is the equation of an 
ellipsoid centered on the point Xg,Yg,2g such that there is a 90% 
probablility that the true point falls inside the surface. Hence, 
if X,Y,Z 1s set equal to the true coordinates of the check point, 
then the resulting value of S should be less than 6.25 for 90% 
of the points tested. If this is not the case, then either the 
assumed true position of the check point is in error or there is still 
a systematic error affecting the orbital positions. 

By transforming the covariance matrix into a local coordinate 
system, the horizontal and vertical components can be treated separately. 


This transformation is given by 


oy = K og kT (51-8) 
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Where oy, is the covariance matrix in the local coordinate system, 


op is the covariance matrix in the geocentric coordinate system, and 


cos © cos i} cos sin sin ¢ 
K = -sin cos } 0 ($2-B) 
-sin @ cos -sin ® sin i cos ¢ 


in which @ is the geodetic latitude, and A is longitude. 

The elevation variance o, is the 3,3-element of o,;. The 
90% assurance interval for elevation will be the square root of this 
variance mltiplied by 1.645. 

The horizontal position covariance matrix is the 2 x 2 
obtained from deleting the last row and column form O;- The eigen- 
values of this matrix can be obtained directly from subroutine 
EIGEN2 given in Appendix C of this report. 


The ratio of the square roots of these eigenvalues 


Ck 
€ 
2 


is used as argument in Table 11 to obtain a value of K such that 


= 
r K Ee. 


- 


is the radius of the associated probability circle. The units of 
this radius will be the same as those of the original covariance matrix 
since the eigenvalues are the result of expressing the error ellipse 


in a coordinate system where there is no covariance. 
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SUBROUTINE CUAD (COEF, RFONTL, RNATZ2, ROOTI? 


10 05 66 


THIS SUBROUTINE COMPUTES YHE ROOTS OF THE OUADRATIA@ EQUATION 
COFF Cg} eXews © COEFLQIOX ¢ CNEF( 3) #& Q 

THE OUTPUT CONSISTS OF THE RFAL PARTS OF TWE TWO RADTS CROOT, AND 

ROOTS) AND THE IMAGINAPY PARY CROOTI) WHICH APPLIES TO BTH, 


DIMENSION CCEF C3) 


COMPUTE THE FIRST TERM 
TERMy = “COEF (2)/¢€2,eC0FF (4)) 
COMPUTE THE NISCRIMINANT 
DISCR = TEREy*#2 © COEFI3)/COEF (1) 
IF (DISCR) 2o* 10% 10 


TRE ROQTS OF THIS EQUATION ARE REAL 
TERMg = SORIFC(DISCR) 
ROOT, = TER+H1 «+ TERM 
ROOT? = TERML = TERM 
ROOTI = 0. 
GO YO 30 


TRE ROOTS OF THIS EQUATION ARE COMPLEX 
TERM2 2& SORTFCeNISCR) 
ROOT, = TERMY 
ROOT2 = TERA 
ROOTI = TER2 


RETURN 
END 
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SUBROUTINE FIGEN2 (A, EIGENV) 


10 05 66 


THIS SUBROUTINES COMPUTES THE FIGENVALUES OF A SYMMETRIC MATRIX OF 
TRE SECONL CODER, 


TRE INPUT CONSISTS OF THE MATRIX ACQ2.2) ANDeoo 
TRE OUTPUT EIGENV( 2) IS A VEPTOR OF THE EIGENVALUES OF A, 


SUARQUTINES SEGUTRED HY THIS SUBROUTINE AREFeo 
QUAD (COEF, ROOT{s ROUTZ, ROAFTI?) 


DIMENSION a€2e2)0 CORFC3), EIGENVEQ) 


FORM COEFFICIENTS OF THE CHavaCTERISTIC EQUATION, 
COEF(s) = 4, 
COEF(2) = o(Alge1) + AlDsD)? 
COEF CZ) 2 Alto gd *A(2,9) = AlZsQ)Ee2 
SOLVE THE CHARACTERISTIC ENUATION, 
CALL MUAD (COEF, ELGENVta), EIGEAVE 9), ROOTI) 


RETURN 
END 


HANDLE VIA 


